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Abstract 

Local Search problem, which finds a local minimum of a black-box function on a given graph, 
is of both practical and theoretical importance to combinatorial optimization, complexity theory 
and many other areas in theoretical computer science. In this paper, we study the problem in the 
randomized and quantum query models and give new lower and upper bound techniques in both 
models. 

The lower bound technique works for any graph that contains a product graph as a subgraph. 
Applying it to the Boolean hypercube {0, 1}" and the constant dimensional grids [n]'^, two particular 
product graphs that recently drew much attention, we get the following tight results: 

RLSi{0, 1}") = e(2"/2ni/2), QLS{{0, 1}") = OiT'/^n^/'^), 
RLSiin]'^) ^ e(n''/2) for d > 4, QLS{[n]'^) = e(n''/3) for d>6. 

Here RLS{G) and QLS{G) are the randomized and quantum query complexities of Local Search 
on G, respectively. These improve the previous results by Aaronson 0, Ambainis (unpublished) 
and Santha and Szegedy|2D]. 

Our new algorithms work well when the underlying graph expands slowly. As an application 
to [n]^, a new quantum algorithm using 0(-\/n(loglogrt)^'^) queries is given. This improves the 
previous best known upper bound of 0{n?^^) (Aaronson, 0), and implies that Local Search on 
grids exhibits different properties in low dimensions. 
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1 Introduction 



Many important combinatorial optimization problems arising in both theory and practice are NP- 
hard, which forces people to resort to heuristic searches in practice. One popular approach is 
Local Search, by which one first defines a neighborhood structure, then finds a solution that is 
locally optimal with respect to this neighborhood structure. In the past two decades, Local Search 
approach has been extensively developed and "has reinforced its position as a standard approach in 
combinatorial optimization" in practice 1 . Besides the practical applications, the problem also has 
many connections to the complexity theory, especially to the complexity classes PLS ^ and TFNP 
^. For example, the 2SAT-FLIP problem is Local Search on the Boolean hypercube graph {0, 1}", 
with the objective function being the sum of the weights of the clauses that the truth assignment 
X € {0, 1}" satisfies. This problem is complete in PLS, implying that the Boolean hypercube 
{0, 1}" has a central position in the studies of Local Search. Local Search is also related to physical 
systems including folding proteins and to the quantum adiabatic algorithms '2'. We refer readers 

to the papers 2i il9 20 for more discussions and the book ^ for a comprehensive introduction. 

Precisely, Local Search on an undirected graph G = (V, E) is defined as follows. Given a function 
f : V ^ N, find a vertex v G V such that f{v) < /{w) for all neighbors w oi v. A class of generic 
algorithms that has been widely used in practice is as follows: we first set out with an initial point 
V €z V, then repeatedly search a better/best neighbor mitil it reaches a local minimum. Though 
empirically this class of algorithms work very well in most applications, relatively few theoretical 
results are known about how good the generic algorithms are, especially for the randomized (and 
quantum) algorithms. 

Among models for the theoretical studies, the query model has drawn much attention [3 01 
151 116L [T7I I20| . In this model, / is given by a black-box, i.e. f{v) can be accessed by querying 
V. We only care about the number of queries made, and all other computations are free. If we 
are allowed to toss coins to decide the next query, then we have randomized query algorithm. If 
we are allowed use quantum mechanics to query all the positions (and get corresponding answers) 
in superposition, then we have quantum query algorithms. The deterministic, randomized and 
quantum query complexities, are the minimum number of queries needed to compute the function 
by a deterministic, randomized and quantum query algorithm, respectively. We use RLS{G) and 
QLS{G) to denote the randomized and quantum query complexities of Local Search on graph G, 
respectively. Previous upper bounds on a general TV-vertex graph G are RLSiG) = 0{VWd) by 
Aldous 4 and QLS{G) = 0{N^/^5^/^) by Aaronson 0, where 5 is the maximum degree of G. Both 
algorithms actually fall into the category of generic algorithms mentioned above, with the initial 
point picked as a best one over a certain number of random samples. Immediately, two questions 
can be asked: 

1. On what graphs are these simple algorithms optimal? 

2. For other graphs, what better algorithms can we have? 

Clearly the first one is a lower bound question and the second one is an upper bound question. 

Previously for lower bounds, Aaronson showed the following results on two special classes of 
graphs: the Boolean hypercube {0, 1}" and the constant dimensional grid [nY: 

RLSi{0, 1}") = r!(2"/V«'), QLSi{0, 1}") ^ r!(2"/Vn); (1) 

RLSi[nf) = n{n''/^-'/logn), QlSHnf) ^ nin"^^^-^^^ / y/k^). (2) 

It has also been shown that QLS{[nY) = ri(n^/^) by Santha and Szegedy in I^OIj besides their main 
result that the deterministic and the quantum query complexities of Local Search on any graph are 
polynomially related. However, the question 

3. What are the final values of QLS and RLS on {0, 1}" and [n]'^? 

remains an open problem, explicitly stated in an earlier version of |21 and also (partially) in |2(Jj. 

^Polynomial Local Search, introduced by Johnson, Papadimitriou, and Yannakakis |14|. 
^The family of total function problems, introduced by Megiddo and Papadimitriou 
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In this paper, we answer questions 1 and 2 for large classes of graphs by giving both new lower 
and upper bound techniques for randomized and quantum query algorithms. As a consequence, we 
completely solve the question 3, except for a few small c?'s where our new bounds also significantly 
improve the old ones. 

Our lower bound technique works for any graph that contains a product graph as a subgraph. 
For two graphs Gi = {Vi,Ei) and G2 ~ (V2,i?2), their product Gi x G2 is the graph G = (y,E) 
where V — Vi x V2 and 

E = {{vi (g)V2,v[ (g) V2) ■■ {vi,v[) e Ei,V2 e V2} U {{vi (g) V2,vi (g>v'2) : (^2,^2) e E2,vi e Vi} (3) 

We will also use the notion of random walk on graphs to state the theorem. Given a graph G = 
(V, E), a random walk is a mapping W : V ^ 2^ where W{u) C {u} U {v : {u, v) G E}. Intuitively, 
at each step the random walk W goes from the current vertex u to a uniformly random vertex in 
W{u). The walk W is regular if |W^(u)| — c for each u & V. Denote by p{u,v,t) the probability 
that the random walk starting at u is at w after exactly t steps. Let pt = max„^i, p(u, w, t). The 
following theorem is a special case of the general one (Theorem l^l in Section |21 

Theorem 1 Suppose G contains the product graph Gi x G2 as a subgraph, and L is the length of 
the longest self-avoiding path in G2. Let T = \_L/2\, then for any regular random walk W on Gi, 
we have 



The proof uses the quantum adversary method, which was originally proposed by Ambainis |Zj 
and later generalized in different ways El H-'^l HHj ■ Recently Spalek and Szegedy made the picture 
clear by showing that all these generalizations are equivalent in power [JI]. On the other hand, in 
proving a particular problem, some of the methods might be easier to apply than the others. In our 
case, the technique in [221, which generalizes the one in ^ slightly in the form though, turns out 
to work very well. Our proofs for the randomized lower bounds will use the relational adversary 
method, which was proposed by Aaronson [2] inspired by the quantum adversary method. 

Both the quantum adversary method and the relational adversary method are parameterized by 
input sets and weight functions of input pairs. While previous works [^I2U| also use random walks 
on graphs, a key innovation that distinguishes our work from the previous ones and yields better 
lower bounds is that we decompose the graph into two parts, the tensor product of which is the 
original graph. We perform the random walk only in one part, and perform a simple one-way walk 
in a self-avoiding path in the other part, which serves as a "clock" to record the number of steps 
taken by the random walk in the first part. The tensor product of these two walks is a random 
path in the original graph. A big advantage of adding a clock is that the "passing probability" , the 
probability that the random path passes a vertex v within T steps, is now the "hitting probability" , 
the probability that the random walk in the first graph hits v after exactly t steps, because the 
time elapses one-way and never comes back. The fact that the hitting probability is much smaller 
than the passing probability enables us to achieve the better lower bounds. Another advantage of 
the clock is that since the walk in the second part is self-avoiding, the resulting random path in the 
original graph is self-avoiding too, which makes the analysis much easier. 

Applying it to the two graphs {0, 1}" and [n]'^, we improve previous results and show tight 
bounds on both RLS and QLS (except for a few cases in the low dimensional grids). 




Theorem 2 



RLS{{0, 1}") = e(2"/2„i/2), QLSi{0, 1}") = e{2''^^n^/^). 



(4) 
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Theorem 3 



RLS{[n]'^) = { r!((nVlogn)i/2) tf d = 3, QLSi[n]'') 
r2(n2/3) ifd^2. 



n{{n^ / \ogny^^) ifd = 5, 

tfd^A, (5) 



It is worth to note that to apply Theorem ^ we need not only know the mixing time of the random 
walk in Gi, but also know its behavior before mixing. So the applications are not simply using 
standard upper bounds on the mixing times, but involving heavy analysis on the whole mixing 
processes. 

When proving Theorem O by Theorem ^ one difficulty arises: to decompose the grid [n]'^ into 
two parts [n]™ and [n]''~™, we implicitly require that m is an integer. This lets us get lower bounds 
weaker than Theorem^ especially for low dimension cases. We get around this problem by cutting 
one of the m dimensions into many blocks, and use different block to distinguish different time 
windows. Between adjacent blocks are pairwise disjoint path segments, which thus thread all the 
blocks into a very long one. Using this technique, we can apply Theorem ^ for any read-number 
dimension m < d — 1. 

In the second part of the paper, we consider upper bounds for Local Search. While the generic 
algorithms [2 E] are simple and proven to be optimal for many graphs such as the ones mentioned 
above, they are far from optimal for some other graphs. For example, it is not hard to see an 0(log N) 
deterministic algorithm for the line graph G. Therefore, a natural question is to characterize those 
graphs on which Local Search is easy. It turns out that the expansion speed plays a key role. 
For a graph G — {V,E), the distance \u — v\ between two vertices u and v is the length of the 
shortest path connecting them. (Here the length of a path is the number of edges on the path.) 
Let c(fc) — maxtigv \{u : |u — t;| < fc}|. Apparently, the smaller c{k) is, the more slowly the graph 
expands. (Actually c(fc) is an upper bound of the standard definition of the expanding speed.) As 
a special case of Theorem 1121 in Section |5| the following upper bounds in terms of c{k) hold. 

Theorem 4 // c(fc) = 0{k'^) for some constant a > 1, then 

i?L^(G) gL5(G) = |^(^^(^°^^°^^)'0 ^^">^' (6) 

[O(logdloglogd) tfa^l. [O(logdloglogd) if a = 1. 

where d is the diameter of the graph G. 

As a special case, on the line graph we get a — 1 and hence RLS = 0(log7iloglog?i), which helps 
to explain why Local Search on the line graph is easy. Also, it immediately gives a new upper bound 
for QESdn]"^) as follows. Together with Theorem^ this implies that Local Search on grids exhibits 
different properties in low dimensions. 

Theorem 5 QLS{[nf) = 0(^/7I(loglogn)i-^) 

Other related results. After the preliminary version of this paper appeared, Verhoeven independently 
showed an upper bound in terms of the genus of the graph 22 , giving an 0{^/rilog\ogn) quantum 
algorithm for [n]^. There is also an unpublished result on QLS{{0, 1}"): it is mentioned in 2 that 
Ambainis showed ^^^({0, 1}") = r2(2"/Vn°^^^)- ^ 



''Another unpublished result was mentioned in |20) that Verhoeven showed RLS{[n]'^) = Q{n^~^) for any constant 
S > 0. But according to an author of |20|. the proof was never written up and this question should be considered now to 
be still open. 
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2 Preliminaries and notations 



We use [M] to denote the set {1, 2, A/}. For an n-bit binary string x = xo...Xn-i G {0, 1}", let 
a;*^'^ — XQ...Xi^i{l — Xi)xi+i...Xn^i be the string obtained by flipping the coordinate i. 

For graphs Gi = {Vi,Ei) and G2 = (V2, i?2), we say that Gi is a subgraph of G2 if Vi C V2 and 
£-1 Q E2. Apparently, any local optimum in G2 is also a local optimum in Gi (but not the other 
way around in general), therefore any lower bound for Gi is also a lower bound for G2. 

We will use vi ® V2 to range over the set Vi x V2. There are various ways to define a product 
graph Gi X G2 = (Vi x V2,E) by different choices of E. Three possibilities are 

1. E = {{vi(»V2,v[ (g) V2) ■■ {vi,v[) £ Ei,V2 e V2} U {(wi «) W2,wi «> W2) : (^'2,^2) & E2,vi € Vi}; 

2. E' = {{vi (g) V2,v[ (g) V2) ■■ {vi,v[) e EiU Ivi and (v2,W2) e U /yj - IvixV2, where ly = 
{{v,v) -.veV}; 

3. E" = {{vi «) V2,v[ (g) v'2) : e £^1 U /y^ or {v2,v'2) S £2 U /yj - ly^xv^- 

It is clear that E C E' C E", and our lower bound theorem will use the first definition E, making 
the theorem as general as possible. 

A path X in a graph G = {V, E) is a sequence (wi,. ..,«;) of vertices such that for any pair 
(vi,Vi+i) of vertices, either Vi = Wi+i or G E. We use set{X) to denote the set of distinct 

vertices on path X. A path is self-avoiding if fi, vi are all distinct. The length of a path 
{vi, ...jVi) is ^ — 1. For two vertices u,v G V, the distance \u — v\g is the length of a shortest path 
from u to V. The subscript G may be omitted if no confusion is caused. 

The (fc, Z)-hypercube Gk,i — iV,E) where V = [fc]' and whose edge set is E — {{u,v) : 3i e 
{0, l~ 1}, s.t. \ui — Vi\ = 1, and uj = Vj, Vj ^ i}. Sometimes we abuse the notation by using [fc]' 
to denote Gk.i- Note that both the Boolean hypercube and the constant dimension grid are special 
hypercubes.^ 

In an TV-vertex graph G = {V,E), a Hamilton path is a path X = {vi,...,vn) such that 
{vi,Vi+i) € E for any i e [A^ — 1] and set{X) — V. It is easy to check by induction that ev- 
ery hypercube [kf has a Hamilton path. Actually, for I — 1, [k] has a Hamilton path (1, k). Now 
suppose [ky has a Hamilton path P, then a Hamilton path for [fc]'+^ can be constructed as follows. 
First fix the last coordinate to be 1 and go through P, then change the last coordinate to be 2 
and go through P in the reverse order, and then change the last coordinate to be 3 and go through 
P, and so on. For each {k,l), let HamPathk^i — (wi, ...,vn) be the Hamilton path constructed as 
above (where N = fc'), and we define the successor function Hk^i{vi) — Vi+i for i E [A^ — 1]. 

As mentioned in Section a deterministic query algorithm for a function f : I"^ ~* [M] accesses 
the input x e /" only by making queries in the form of "xi ~T\ Each query has cost 1, and all the 
other computation between queries are free. A randomized query algorithm is the same except that 
the algorithm can toss coins to decide which variable Xi to ask next. The quantum query model, 
formally introduced in [^, has a working state in the form of ^ ^ Oii^a,z\i^ a, z). A quantum query 
on the input x proceeds as follows. 

ai,a,z\i, a, z) ^ ^ ai^a,z\h a © Xi, z) (7) 

A T-query quantum query algorithm works as a sequence of operations 

Vq^O^^Vx^O^^ ... ^ Ut-1 -^O^^Ut (8) 

where Ox is as defined above, and each Ut does not depend on the input x. In both randomized 
and quantum query models, we can allow a double-sided small constant error probability. The 
deterministic, randomized and quantum query complexities, denoted by D(f), i?2(/) and Q2if), 
are the minimum numbers of queries we need to make in order to compute the function by a 
deterministic, randomized and quantum query algorithm, respectively. For more details on the 
query models and the corresponding query complexities, we refer to [lOj as an excellent survey. 

■'Here we identify the Boolean hypercube {0, 1}" and G2,n since they are isomorphic. 
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2.1 One quantum adversary method and the relational adversary method 

The quantum adversary method is one of the two powerful tools to prove lower bounds on quantum 
query complexity; see |13j for an comprehensive survey of this research area. In this paper, we will 
use the quantum adversary method proposed in |23| . The definition and theorem given here are a 
little more general than the original ones, but the proof remains unchanged. 

Definition 1 Let F : — > [M] be an N-variate function. Let R C L^ x L^ be a relation such that 
F(x) 7^ F{y) for any (x, y) ^ R. A weight scheme consists of three weight functions w{x, y) > 0, 
u{x, y,i) > Q and v{x, y,i) > Q satisfying u{x, y, i)v{x, y, i) > w'^{x, y) for all [x, y) E R and i G [A^] 
with Xi yi- We further put 

w^^ X! w{x,y'), Wy= ^ w{x',y) (9) 

Ux,z= ^ u{x,y',i), Vy^i= ^ v{x',y,i). (10) 

y'-{x,y')eR,Xi^y'. x':(x\y}<£R,x'.^yi 

Theorem 6 [Zhang, \2'6\ ] For any F, R and any weight scheme w^u,v as in Definition^ we have 



Q2{F)^n( min (11) 

\(x,y)(^R,t(i[N]: Xi^y, \J U^^iVy.i ) 

In |2|, Aaronson gives a nice technique to get a lower bound for randomized query complexity. 
We restate it using a similar language of Theorem 

Theorem 7 [Aaronson, 2 ] Let F : [AI] be an N-variate function. Let R C x be a 

relation such that F{x) ^ Fly) for any {x,y) G R. For any weight function w : R R+, we have 



i?2(F) ^ni min max <^ — ^, } (12) 

\{x,y)eR,ie[N],x,^y, [WxA Wy^ijJ 

where 

Wx,i= ^ w{x,y'), Wy^i= ^ w{x',y). (13) 

y' :{x.y')^R.Xi^y' x' -.[x' ,y)^R,^x'.^yi 

Note that we can think of Theorem having a weight scheme too, but requiring that 
u{x,y,i) ~ v(x,y,i) — w(x,y). This simple observation is used in the proof of Theorem [3 and 

m 

3 Lower bounds for Local Search on product graphs 

In this section we prove a theorem which is stronger than Theorem ^ due to a relaxation on the 
conditions of the random walk. Suppose we are given a graph G — (V, E), a starting vertex vo and 



V 



an assignment W : V x E ^ 2^ s.t. for each u <E V and t G N, it holds that W{u,t) C {u} U { 
(u, v) G E} and that |M^(u, t)\ = Ct for some function c of t. Intuitively, W gives the candidates that 
the walk goes to for the next step, and the random walk (G, vq, W) on graph G proceeds as follows. 
It starts at vq, and at step t G N, it goes from the current vertex Vt-i to a uniformly random vertex 
in W{vt-i^t). We say a path (yo,Vi, ...,vt) is generated by the random walk if Vt G W{vt-i,t) for 
all t Cz [T]. Denote by p{u, ti , w, ^2) the probability that the random walk is at v after step ^2 under 
the condition that the walk is at u after step ii. Let pt — maxu.v,ti,t2: t2-ti=tp(u,ti,v,t2). For 
{u,u') G i?, let g(u, m', ii, w, ^2) be the probability that the walk is at v after step <2, under the 
conditions that 1) the walk is at u after step ti, and 2) the walk does not go to u' at step ti + 1. 
The following lemma on the relation of the two probabilities is obvious. 

Lemma 8 // ti + 1)| > 1, then q{u, u', ti,v, t2) < 2p{u, ti,v, t2). 
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Proof By considering the two cases of the step ti + 1 (going to u' or not), we have 



Thus 



□ 



p{u, ti,v, t2) = \ im P("'' h + ^,v, ia) + ( 1 - ! , iM ) <?(", m', ii, , i2)- (14) 

q{u,u\ti,V,t2) <p{u,ti,V,t2)/ ( 1 - JTTT-, — ] -I ) < 2p{u,ti,v,t2). (15) 

V \W{u,ti + l)\J 



Theorem 9 Suppose G contains G"" x C as a subgraph, and L is the length of the longest self- 
avoiding path in . Let T = \ L/2\, then for the random walk [G"^ ,Vq , W) on G"", we have 

RLS{G) = n i — ) , QLS{G) = Q I ) . (16) 

\Lt=iPt \Et=iVPt/ 



Proof Without loss of generahty, we assume G — G"" x C^, as Local Search on a subgraph 
is no harder than Local Search on the original graph. We shall construct a random walk on G 
by the random walk {G'^,Vq,W) on G"" and a simple one-way walk on C^. Starting from some 
fixed vertex in G, the walk is proceeded by one step of walk in G^ followed by two steps of 
walk in G"^. (We perform two steps of walk in mainly for some technical reasons, and this 
is where the factor of 2 in definition T = [L/2\ comes from.) Precisely, fix a self-avoiding path 
{zq^q, Zi^Q, Zi I, Z2 I, Z2^2i ^TT-i' ^tt) length 2T in G'^. Let the set P contain all the paths 

X ("^0 ^0 ' ^0 ' ^1 ' "^1 ^1 1 ' • ■ ■ J '^'P' ]^ 'P ]^ ; Xrp ZfJ~i fj-i , Xrp Zrj-i fj-i^ IH G SU-Cll 

that Xq — Vq and (a;^, a;™, a;^) is a path generated by the random walk {G"^ ,Vq ,W). Define 
a problem PATHp: given a path X £ P, find the end point (g) z^rp. To access X, we can ask 
whether v e set{X) for any vertex v £ V, and an oracle O will give us the Yes/No answer.^ The 
following claim says that the Path p problem is not much harder than Local Search problem. 

Claim 1 R2{PATiip) <2RLS{G), Q2iPATiip) < 2QLS{G). 

Proof Suppose we have an Q-query randomized or quantum algorithm A for Local Search, we 
shall give a 2Q corresponding algorithm B for PATHp. For any path X e P, we define a function 
fx essentially in the same way as Aaronson did in j^j: for each vertex v G G, let 




o.olG 



- 3T if t; <^ set{X) 

if w = a;^ (g) z'^ ^. 



fx{v) = < - /c./c (^7) 



if w = a;^+i z^+^^fc 



It is easy to verify that the only local minimum is x^ ® z^rp. 

Given an oracle O and an input X of the Path problem, B simulates A to find the local minimum 
of fx, which is also the end point of X. Whenever A needs to make a query on v to get fx{v), 
B asks O whether v £ set{X). If v ^ set{X), then fx{v) = \v — x^ ® 2^0,0 1 G + ST; otherwise, 
V — x"^ ® z'j.j^i J. or w = (g) J, for some a;™ € V"^ and k. Note that k is known for any given 
vertex v. So if w = a;™ ® z'j^^^ j,, then — x^j^-^ and thus fx{v) = 3(T — fc) — 2. Now consider 
the case that v = x"" ® z^^^. If fc = 0, then let fx{v) = 3T if w = x^ » zg ^ and fx{v) = ST - 1 
otherwise. If fc > 1, then B asks O whether x™ (g) zj: g set{X). If yes, then v = x"^ ® z'^^, and 
thus fx{v) = 3(r - fc); if no, then v = x^+i ® z^^' x^^ zl ^ and thus fx{v) = 3(T - fc) - 1. 



^Note that it is actually an oracle for the following function g : {0, 1}" {0, 1}, with g{x) = 1 if and only if s G set(X). 
So strictly speaking, an input of PATHp should be specified as set(X) rather than X, because in general, it is possible 
that X Y but set{X) = set{Y). For our problem, however, it is easy to check that for any X,Y £ P, it holds that 
X — Y ^ set(X) = set{Y). Actually, if A" 7^ Y, suppose the first diverging place is fc, i.e. x'^_i = y™-i, but 7^ . 
Then Y will never pass x^ (g) 2^ because the clock immediately ticks and the time always advances forward. (Or more 
rigorously, the only point that Y passes through 2fe.fc_i is j/™ d?) Since y™ 7^ a;™, x™ ® ^ set{Y).) 
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Therefore, at most 2 queries on O can simulate one query on so we have a 2Q algorithm for 
PATHp in both randomized and quantum cases. □ 

(Continue the proof of Theorem O By the claim, it is sufficient to prove lower bounds for PATHp. 
We define a relation Rp as, follows. 

i?P = {(X, r) : X e P, r e P, X and Y has different end points}. (18) 

For any pair {X, Y) e Rp, where X = {xq®Zqq, Xi®Zqq, Xi®Ziq, Xi^z^^, a;^®2;^_^ rp_^,x'i^® 

Zj, T— 1' x^®z^ rp) and Y = {yo ^^q.qj yT^^ofi' vT^^ifl^ yT^^i,!' Vt^^t—i t-1 ' Vt^^t t— i' Vt^ 
z^j,), we write X AY = k if ^ , 'x^.i = y^-i butx^ ^ . Intuitively, X AY = k if 
k is the place that the paths X and Y diverge for the first time. Note that if X A Y = k, then 
^k^Vk € W{x'^_^,k) and thus \W{x'^_j^,k)\ > 2. By LemmaEl this implies that g(x]^_i, x]^, fc - 

We choose the weight functions in Theorem |B1 by letting 

w{X,Y) = 1/\{Y' e P -.Y' AX = k}\ (19) 
= 1/\{X' e P : X' AY ^ k}\ (20) 
- l/[(cfc-l)cfc+i...CT]. (21) 

To calculate wx — J2y'-{x Y')£Rr ^(^i^')j "^"^ group those Y' that diverge from X at the same 
place k': 



wx 



^ ^ w{X,Y') (22) 
*-■'=! y':(x,y)6-Rp 

^ ^ \\Y' ^P:Y' AX = k'}\ ^^^^ 



^ Pry4(x,r') e Pp|y' AX = /c'] (24) 
fc'=l 

T 

5]Pri^.[(y')¥7^^¥l>"'AX = fc'] (25) 



fe'=i 



Here Equality (|24|l holds because all paths diverging from X firstly at k' have the same prob- 
ability l/[{ck' — l)cki ...ct\. Also note that the probability in the last equality is nothing but 
1 — q{x'^, _T^,x^, ,k' — l,x^,r), which is at least 1 — 2pT-fc'+i- So we have 



T 



wx>T -2Y,PT-k-+i^T -2^pt. (26) 



t=i 



And similarly, we have wy >T — 2 X^tLi Pt too. 

Now we define u{X,Y,i) and v{X,Y,i), where i is a point xjj^^ (g) ^;|+s.j G set{X) — set{Y) or 



e set(y) - set{X). Here (r, s) e {(0, 0), (1, 0), (1, 1)}, and < j < j + r < T. Let 



u{X, Y, xj+, ® z;+,^^.) = ak,j^rMX, Y), u{X, Y, yj^^ ® z^^^^^) - 6^,,, .,.w;(X, F), (27) 

v{X, y, ® z^V,^^.) = bk,j,rMX, Y), v{X, Y, yf^^ (g> z^^^^^) = a^.^^rM^, Y). (28) 

where ak,j,r,s and bk,j,r,s will be given later (satisfying ak.j,r,sbk,j,r,s = 1, which makes u,v,w really 
a weight scheme). We shall calculate ux,i and VY,i for i = xj_^_j. (g) z|+sj G sei(Ar) — set{Y) ; the 
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other case i — yj^^ (g) Zj^^j is just symmetric. Note that if xj^j. (g) Zj+s,j ^ set{Y') and X AY' — fc', 
then k' < j + r. 

j+r 

ux,xj^^(x,z-^^^^ = ak',j,r,sw{X,Y') (29) 

k' = l Y':{X,Y')£B.p,Xf\Y'=k' 
j+r 

^Y. ak',j,r,MX,Y') (30) 

fe' = l Y':X/\Y'=k' 
j+r 

— ^ ak',j,r,s (31) 
fc'=l 

The computation for vy,x'^^ (82"=+ httle more complicated. By definition, 

j+r 

= XI X! bk'j^r,sw{X',Y) (32) 

fc'=i x':(x',y)e_Rp, x'Ay=fc', 

xJ+^(»z'=^^.jeset{X') 

j+r 

<Y Y bk',j,rMX',Y) (33) 

fc' = l X':X'Ar=fe', 

3:™+r«iZj°+,jeset(Js:') 

= X ,,,Prx' ® e set(X')|X' A F = fc'] (34) 

fc'=i 

We can see that by adding the clock, the passing probabihty Prx' [a;]"^^ (X" Zj_^_g j g set(X') |X' A F = 
k'] is roughly the hitting probability g(y^,_i, y^, , /c' - l,x-+„j) + g(y^,_i, y^; , /c' - l,x-+„j + 1) 
except for some corner cases. To be more precise, define 

Boundk'j,r,s = 2pj^k'+2 • A[s = 1 OR j <T]+ 2pj^k'+i • A[s = AND (fc' <jORr = 0)] (35) 

where the Boolean function A[0] = 1 if (/> is true and otherwise. Then 

Claim 2 Pr^' [xj_^r ® ^l+^j e .sei(X')|X' A F = fc'] < Boundk' ,j,r,s. 

Proof We study the probability Prx'[xJ_^_^ (8) zj^.^ ^ € set{X')\X' AY — k'] case by case. If s = 1, 
then r = 1, and (g) z^^^^ j e se<(X') if and only if xj_^^ = (a^OjVi- So 

Prx'[xJ+r » ^1+.,, e set(X')|X' AY = k']= q{y^, _^,y^, ,k' - 1, xj+i, j + 1) < 2p,^k'+2 (36) 

by Lemma IHl If s = 0, then xj+^ ® zlj e se<(X') if and only if "a;]"+^ = (x') or a;]"+^ = (a;')}"+i". 
Also note that 

Prx'[<+r = i^')7\X' AY^k']^ q{y^,_^,y^,,k' - l,a;!r+„ j) (37) 

unless k' = j + 1 and r = 1, in which case Prx' [x^+j. = (x')™ |X' A F = fc'] =0 because x^_^-^ ® z^ j ^ 
set(Y) but (a;')7 «> = y]" «) € set{Y). The other probability 

^ (x')-«|X' A r . .'I . - + ;f ^ ^ - 1 , (38, 

Putting all cases together, we get the desired result. □ 
(Continue the proof of Theorem^ The claim implies that 

j+r 

- Y^ bk',j,r,sB0Undk',j,r,s- (39) 

fc'=l 
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The symmetric case of u{X,Y,i) and v{X,Y,i) where i is a point yf-^r ^ '^j+s j ^ set{Y) — 
set{X) can be dealt with in the same way, yielding ux.y"'^ ®z<;^ . < '^'jJ^Zibk' ,j,r.sBoundk' j,r,s 

and VY,yY_^^®z-^^ ,^ < Lfctli afc'j\r,s- 

By the definition of Boundk' .j,r,s, it holds for any {j,r,s) that 

j+r T j+r T 

Boundk', J, r,s < 4^pt and ^ y^Boundk> j,r,s ^/p^. (40) 

fe'=i t=i fc'=i t=i 

Now for the randomized lower bound, ak>j.r,s = ^k' .j,r,s = 1- 

RLS{G) = n fminmax| ^-'^^=i^* , ^"^^^=1^* \\ = f7 f ^— ^ . (41) 



For the quantum lower bound, pick ak',j.r,s = \/ Boundk' ,j,r,s, and bk',j,r,s ~ ^1 \/ Boundk' ,j,r,! 
Then 



QLSiG) = n 



mm 











(Zfetli \/ Boundk', J, r,s^ 


{J2k^=i \/ Boundk' J, r,s) 



/ T 



(42) 

This completes the proof of Theorem El □ 



4 Applications to the two special graphs 

In this section, we will apply Theorem El to the two special graphs. Note that in both cases, the 
probability pt is not easy to upper bound. Also note that we need not only to pick the random 
walk, but also the way to decomposed the graph. 

4.1 Lower bounds for Local Search on the Boolean Hypercube 

To apply Theorem (51 to {0, 1}", we decompose the whole graph into the two parts {0, 1}'" and 
{0,1}"^™, where m is to be decided later (and to be taken different values for randomized and 
quantum lower bounds). Pick the random walk {{0,1}"'^,Vq ,W), where Vq = 0™ G {0,1}™ and 
W{x,t) = {x^*^ : i e {0,...,m — 1}} for each vertex x = xo...Xm.-i S {0,1}™ and each t £ N. 
Finally, note that the longest self-avoiding path of the graph {0, l}"^™ is a Hamilton path with 
length L = 2""™ - 1. 

The following bounds on pt are rather loose for 10 < i < but sufficient for our purpose. The 
proof of the lemma uses some techniques in generating functions and Fourier analysis. 

Lemma 10 For any t e N, we have 

{0(m-r*/2l) if t< 10 
0(m-5) i/ 10 < f < (43) 

0(2-™) tf t>m^ 

Proof Consider that we put t balls randomly into m bins one by one. The j-th ball goes into 
the ij-th bin. Denote by ni the total number of balls in the i-th bin. We write = hi if bi = 
ni mod 2. We say that (ii,...,it) generates the parity sequence (&i,...,6m), or simply (ii,...,Zf) 
generates (bi, ...,b„i), if ni = bi for all i G [m]. For hi. ..bm G {0,1}™, denote by p*^*^ 6„i] 
the probability that ni = bi, Vi € [m]. Let p*^*^ = maxb^^....;,^^ p'*-* ...,bm]- It is easy to see that 
= in Lemma llOl so it is enough to prove the same bounds in Lemma 1 101 for p^*). 
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We start with several simple observations. First, we assume that t and i h have the same 
parity, because otherwise the probability is and the lemma holds trivially. Second, by the symme- 
try, any permutation of 61, bm does not change bm)]- Third, bm)] decreases 
if we replace two I's in 61, bm by two O's. Precisely, if we have two bi's being 1, say 61 = 62 = 1, 
then p^*^[{bi, ...,bm.)] < p(*^[(0,0, 63, In fact, note that 

pW[(6i,...,U] = A E -r-^ (44) 



- y 

ns + ...+nm<t 



(m + n2)!n3!...n„! ni!n2! 

^ ' ni+n2=t—n3— — 



ni = i)j,»=3,...,m \ nj=6i,i=l,2 

where as usual, let 0! = 1. If 113 + ... + < t, then 

V- (rti +n2)! ^ (»i +"2)! .^g. 

m+n2=t — "3 — 711+712=* — "3 — 
ni = l,»=l,2 ni=0,» = l,2 

If ns + ... + Hm = t, then the only possible (ni, 722) is (0, 0), so 

V (ni+M^o, V (^^1±^ = 1. (47) 

^ ni!n2! _^ ni!n2! ^ ^ 

'"'i+''T'2— ^3 — rim, ni-\-n2—t—n3 — ...—nm 

71^ = 1, i = l, 2 7ii=0,i=l,2 



Thus 1, 63, -, < p(*)[(0, 0, 63, 6„0]. 

By the observations, it is sufficient to prove the lemma for the case p*^*) [(0, 0)] if t is even, and 
for the case p^*^ [(1, 0, 0)] if t is odd. Note that if t is even, then 

m 

pW [(0, 0)] = Pr[ii = i]Pr[(i2, it) generates (e^)] (48) 

7=1 

where Ci is the m-long vector with only coordinate i being 1 and all other coordinates being 0. 
By the symmetry, /*-^^[ei] = ... = j/*"^)[c,n], thus ^^[(O, ...0)] = p(*-^)[ei] = p^*-^) [1, 0, 0]. 
Therefore, it is enough to show the lemma for even t. 

We now express p^*^[0, 0] in two ways. One is to prove the first case {t < 10) in the lemma, 
and the other is for the second case (10 <t< ni^) and the third case {t > m^) in the lemma. 

To avoid confusion, we write the number m of bins explicitly as subscript: Pm bm]- We 

consider which bin(s) the first two balls is put into. 

p^^ [0, 0] = Pr[*i = Z2]p(^-2) [0, 0] + Pr[*i ^ i2]p'i-^^ [1, 1, 0, 0] (49) 

= [0, 0] + ^Pt'^ [1, 1, 0, 0] (50) 

To compute Pm~^^[l, 1,0, ...,0], we consider to put {t — 2) balls in m bins. By the analysis of the 
third observations above, we know that 

p(^-2)[0,...,0]-p(^-2)[l,l,0,...,0] (51) 
=Pr[ni =712 =0,n3 = 0,...,n„ = 0] (52) 
=Pr[ni = 712 = 0]Pr[n3 = 0, n„ = 0|ni = 712 = 0] (53) 



77Z — 2 



m 



pL2^[0,...,0] (54) 



Therefore, 

t-2 



^'^^'[0,...,0] = ^e^)[0,...,0]-^(^) " ^-J[0,...,0] (55) 

fit lib \ lit J 
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(2) 

Now using the above recursive formula and the base case Pm 

[0, ...,0] = 1/rn, it is easy (but 

tedious) to prove by calculations that pm[0, ...,0] = {{t — l)!!/m3)(l — o(l)) for even t < 10. This 
proves the first case in the lemma. 

For the rest two cases, we shall use generating function and some technique inspired by Fourier 
analysis. Consider the generating function 

ix^ + ... + Xmy^ J2 ( ^ (56) 

If X, e {-1, 1}, then (xi + ... + XrnY = E,n+...+n^=t ,. ,n„ j (" 1 ) ' ''"'^'^ ' ' Wc sum it over 
all xi...Xm S {"Ij 1}™- Note that for those (rii, ...,rtm) that has some = 1, it holds due to the 
cancelation that '^^^ ^ g{-i ]^i,(— l)'''^*'^'^"^'"'^^^' = . On the other hand, if all n^'s are even, 
then E:ri,...,^„G{-i,i}(-l)'^'^''*"~^'"'^^^' = 2". Thus we have 



(xi + ... + x„0* = 2" ^ „ )■ (57) 

!:i,...,2:„G{-l,l} ni+...+nm=t 



t 



And therefore, 



p(*)[0,...,0] = i, E f ' ) (58) 



ni-\-...-\-n-m — t 



^ E (X1 + - + -™)* (59) 
xi.,...,x„^e{-i,i} 



1=0 



Note that t is even, so p^*''[0, 0] decreases if t increases by 2, and this proves the second case of 
the lemma with the help of the first case. And if < > m^/2, then 



p(')[0,...,0]<-l^ (2+ (l--)*"^ \ <2/2" + e-™ = 0(l/2™) (62) 



2" \ V m 



i=l 



This proves the third case of the lemma. □ 

Now it is very easy to prove Theorem |21 using this lemma. For the randomized lower bound, 
let m = [(n + log2 ?i)/2j , then T = e{T'/^/n^^^) and 'Zj=iPt = 0{l/n). Thus i?iS'({0, 1}") = 
n(Vri2"/2). For the quantum lower bound, let m = [(2n + log2 n)/3j , then T = e(2"/3/^i/3) a^^j 



Ef=i Vlh = 0(1/V^). Thus QLS{{0, 1}") = r!(2"/3ni/6) 



4.2 Lower bounds for Local Search on the constant dimensional grid 

In this section we shall first prove a lower bound weaker than Theorem 13 in Section [4.2.1l and then 
improve it to Theorem El in Section HT^ and Section 



4.2.1 A weaker family of lower bounds 

To simplify notations, we let n = N^/'^. As in Section EITl we decompose the grid into two parts, 
[n]™ and [n]''"'". For each vertex x = X()...Xm-i € [n]"^ and each i € {0, m — 1}, define 

a;*^*''" = xo...Xi_i max{xi - 1, l}a;i+i...a;„_i, (63) 
x^"^'"*" = xo...Xi_i min{xi + 1, n}xi+i...Xm_i. (64) 
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We perform the random walk ([rt]™, Vq , W) where Vq = 00. ..0 G [n]™ and 



(65) 



To analyze the probability pt in Theorem |^ we first consider the following simpler "line walk" . 
Suppose a particle is initially put at point i G {1, ...,n}, and in each step the particle moves either 
to max{l, « — 1} or to min{n, i + 1}, each with probability 1/2. Let pf^ denote the probability that 
the particle starting from point i stops at point j after exact t steps of the walk. For < > 1, the 
following proposition gives a very good (actually tight) estimate on maxy 

Proposition 11 For any t>l, 



maxp. 



it) 
13 



{0{\/^ft) if t<n^ 
\0(1A 



.) if t > 



(66) 



Before the formal proof, let us briefly discuss the main difficulty and the idea to get around it. 
First note that since we care about the whole mixing process [i.e. before and after mixing), the 
standard eigenvalue gap does not immediately apply. Second, if there are not the two barriers (1 
and n) then pf^ is very easy to calculate: pf^ — {t/2+{j-i)/2) J ~ * ^^"^ ^ have the same parity, 
and otherwise. However, since we now have the two barriers, it is hard to count the number of 
paths from i to j after exactly t steps. Fortunately, there is a basic reflecting rule as follows. 

reflecting rule: In the line walk without barrier, the number of paths from i > to j > in 
exactly t steps touching or crossing the point is equal to the number of paths from ~i to j in 
exactly t steps. 

The proof of this rule is very easy. Suppose a random path touches the point at t for the first 
time, then do a reflection of the first t steps of the path with respect to point 0. See Figure ^ for 
an illustration. It is not hard to see that this gives a 1-1 correspondence between the following two 
sets: 1) the set of paths from i to j after exactly t steps touching or crossing the point 0, and 2) 
the set of paths from — i to j. 




new path 



old path 



Figure 1: The proof of the reflecting rule. 



Now let us consider the barrier setting. Note that a path may try to cross the two barriers in 
some pattern, for example, try to cross the left barrier (i.e. point 1) for a times and then try to 
cross the right barrier (i.e. point n) for b times. Imagine that we now remove the two barriers, 
then the path will touch (from right) but not cross the point 1 — a and will touch (from left) but 
not cross the point n + b — a. To use the reflecting rule, we just need to further note the following 
simple fact: 

{paths touching but not crossing the point 1 — a} 
= {paths touching or crossing the point 1 — a} — {paths touching or crossing the point — a}. 
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Following this idea, we will construct a series of 1-1 correspondences to reduce the problem step by 

step to the no-barricr case. The precise proof is as follows. 

Proof We consider two settings. One is the line walk on n points 0, n — 1 with the two barriers 
and Another is the same except that the barriers are removed, and we have infinite points 

in a line. For each f-bit binary string x = xi...xi, wc use and Qf to denote the two paths that 
starting at i and walk according to x in the two settings. Precisely, at step s, goes left it Xg =0 
and goes right if Xg = 1 ■ Pi goes in the same way except that it will stand still if the point is 
currently at left (or right) end and it still wants to go left (or right). If the end point of Pf is j, 
then we write i ^f'^ j. Let X-*^'^ be the set of a; G {0, 1}* s.t. i — j, and put nf^''^ = \X-j^'^\. 
Then by definition, = n|*^'^/2*. The notations i -^f'^ j, X-*^''^ and n^*^'*^ are similarly defined, 
with the corresponding P changed to Q. Note that nfj^''^ = ((/2+(j-j)/2) if J ~ ^ ^^'^ * have the 

same parity, and otherwise. We now want to upper bound nfj^'^ in terms of n(j''^ ■ 

For a path P^ , if at some step it is at point and wants to go left, we say it attempts to pass 
the left barrier. Similarly for the right barrier. We say a path is in the {as,6s}g^i category if it 
first attempts to pass the left barrier for ai times, and then attempts to pass the right barrier for 
hi times, and so on. Wc call each round a stage s, which begins at the time that Pf attempts 
to pass the left barrier for the (ai + ... + Ug-i + l)-th time, and ends right before the time that 
Pf attempts to pass the left barrier for the (oi + ... + + l)-th time. We also split each stage s 
into two halves, cutting at the time right before the path attempts to pass the right barrier for the 
(6i + ... + bg-i + l)-th time. Note that ai may be 0, which means that the path first attempts to 
pass the right barrier. Also bi may be 0, which means the the last barrier the path attempts to pass 
is the left one. But all other a^, fc^'s arc positive. Also note that in the case of / = 0, the path never 
attempts to pass either barrier. Now for any fixed / > 0, we consider those categories with ai > 
and bi> Q. Other cases can handled similarly. Partition XI-'' as 

XS''= U ^?'"[{'^«>^4i=i] (67) 

where xf^'^[{aaTbsYs^i] contains those x € {0,1}* s.t. P.f is in the category {a.,, 6.,}'^,^;^. Put 
ng''^[{a„6,}Ui] = ^[{a„6,}Ui]|, thus ng'^ = Ei E{„,„5„}U, n^f ^[{a„ fojU^]. 

Now consider the corresponding paths in X^^"^'^ . The following observation relates P^ and Qf . 

Observation 1 For each x G X^^'''^[{as,bs}i^i\, the following two properties hold for any s. 

1. In the first half of stage s, the path Qf touches (from right) but does not cross the point 

2. In the second half of stage s, the path Qf touches (from left) but does not cross the point 

/3s = n-l + Ylr=libr - ar) 

3. The path Qf ends at^ = j + X^s=i(&s — ««) 

We let Yf'^^''^[{as, PsYg^-^] contain those x G {0, 1}* satisfying the three conditions in the above 
observation, and denote by rn\lj'^[{as, PsYs^i] the size of the set l^i^*'''^[{Q!^, Thus the ob- 
servation says X^^'''^[{as,PsYs=i] ^ ^iP''^ [{(^s, f^sVs^i], and therefore we have n\f'^[{as, bs}i=i] < 
m\*:j'^[{as,Psys=i]. So it is enough to upper bound mf^^''^ [{a^, l3s}i^i]. 

Now for each x e Ylp'^[{as, f3s}i^i], if wc change the condition 1 in state s = 1 by allowing the 
path to cross the point ai, and let z|^^'''[{q;s, be the new set satisfying the new conditions, 

then ml;)''3[|^^^^j/^j ^ IZ^'^^'^^Has, f3g}U,]\ - l^i^^'^^lai - l,/3i, {a„/3jU]l- In other words, 
the set of paths touches (from right) but docs not cross ai is the set of paths touches or crosses ai 
minus the set of paths touches or crosses ai — 1. 

^Here we let the n points be 0, n — 1 instead of 1, n just to make the later calculation cleaner. 
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Now we calculate |z|*''''^[{as, /3s}i=i]| by the so-called reflection rule. Suppose the first time that 
Qf touches ai is ti. We reflect the first ti part of the path Qf with respect to the point ai. Precisely, 
let y = (1 — — )a;t^+i...a;t, then the paths Qf and Q2ai-i merge at time ti. And it is easy 

to check that it is a 1-1 correspondence between z'j:!^'^[{as, Psys=i] and i^2ai-i,7[/5i' {"^s; /^s}i=2]i 

Here 5^2Q'i'-i 7[/^i' {"^s, /?s}i=2] tbe set of paths starting at 2ai — i, satisfying (a) the condition 2 
at the first stage, (b) both conditions 1 and 2 at the rest I — 1 stages, and (c) condition 3. So 

= ™^*L'?-,,7[/?i,{«.,A}U] (69) 
- 7+aJA + + ai, A + «i}i=2] (70) 

where H69|l is due to the fact that ai = — ai, and (|7()|l is because that the number of the paths does 
not change if we move all the paths right by ai. Similarly, we have 

|z(;)'«[ai - l,/3i,{a„/3jU]l = "^^^I'^s-.,^!^, AlU] (71) 

= ^^-a?^2~r.j+aM + ^1, + ai,/3s + OllU] (72) 

Therefore, 

ng)'^[{a„6,}Li] < m(y'«[{a„/3jLi] (73) 

= mL*L'?_,,^[/?i,K,/?,}U] ""^^I'^-s-.^I/^i-K^AlU] (74) 
= + ai, {a, + ai, /?, ajU] (75) 

- "^^*af-2-»,7+ai [A + fli , {a, + fli , /3, + Oi jl^^] (76) 

Note that as + ai = 61 + J2t=2i^-r ^ ^r) — o,s, (3s + o-i ~ n — 1 + bi + J2t=2i^r — o,r) and 
7 + fli = j + bi + J2t-=2(^^ ~ ^r) are all functions of (&i, a2, 62, a;, 6;), not of ai any more. 
Therefore, 

^ ng)'^[{a„5,}Li] (77) 

ai,bi,...,ai,bi>0 

^ E E("^-f-,7+aJ/3l+ai'K+«l'A+ai}U] (78) 



bi,...,ai,bi>0 ai>0 



[/3i -Kai,{as +ai,/3s +ai}s=2]) (79) 
= E (rnL*l'5.7+aJ/3i+ai,{a. + ai,/3. + ai}U] (80) 

fci,...,ai,bi>0 

+ mL*^'^,^^+^J/3i -f ai, {as ai, /?s + aijUl) (81) 
< 2max{mL*I'^^,^^+,J/3i+ai,{as + ai,/?s + ai}U]} (82) 

fci,...,ai,tii>0 

Now using the similar methods, i.e. reflecting with respect to points (n — 1 + bi) and (n + 61), 
moving the paths left by bi, and finally collapsing the telescope, we can get 

J2 mL*I'?„+,J/?i+ai,{as-f ai,/3s + ai}U] (83) 

fcl,...,ai,6;>0 

< E 2maxJm(*2+V-fe+i,7+ai-fcJK + «i-^i'/3« + «i-^i}U]} (84) 

a2,f)2,...,oi,6;>0 
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and thus 

n(*)'^[{a„6,}Li] (85) 

ai,6i,...,ai,bi>0 
a2,b2,...Mi,bi>Q 



We continue this process, and finally we get 

1 ^ o2i „ 



ai,;)i,...,ai,;)i>0 

= ^'4^., (89) 

(90) 

Thus 

E E ^^''^[{"-^JLi] (91) 



/>0 ai,6i,...,ai,6i>0 



, „ , In 
i>0 ^2 



<4 



<4 



i/2/ ^ \t/2 + ln 

t/2) ^^^^ ^ (G/2 + ;n) ^ G/2 + ?n-l) ^ {t/2 + In - n + l)) ^^^^ 

((:)+(,!,)+-(,/., „:_„,,)) (»> 

^4(^2) +^E2'''^"2*e-'^'^ (96) 



where (j* ) = if t' > t. Here the first two inequalities are by the monotonicity of binomial coeffi- 
cients, and the last inequality is by ChernofF's Bound. Now if i < n^, then 'J2i>i 2^*-'^^-'e s* < 

E,>i22('+i)e-^ = 0(1), so E.>oEa„.„...,a„.,>o-!?''[K,&JLi] < 0((,;,) +27n) = 
0(2*/ Vt). For other categories of oi = or 6; = 0, the same result can be proved similarly, and 
the / = is easy since n\^j — 0{2^/\/i). Putting all things together, we see that jJff = Oil/Vt) 
if t < n^. The other part, i.e. pf^ = 0{l/n) when t > n^ , can be easily derived from this and the 
fact that maxij pf^ decreases as t increases. This completes our proof. □ 

Now we use Proposition II II to prove the weaker lower bounds for grids. Since the random walk 
([n]™, Vq, W) is just a product of m line walks, it is not hard to see that the pt in the random walk 
{[nY^,v^,W) satisfies 

ro(i/yt^) if^<n^ 

|0(l/n™) if t>n2. ^ ' 

Now for the randomized lower bounds, when d > 4 we pick m = \d/2'\ > 2 and we get 

RLSiinr) ^ n ( ^,,,:\":^, J - ninl^^^^) - (98) 
\0[l)+n'^ '"/n™/ \fl{n2 2) if d is even. 
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Ford = 4,3,2, we let m = 2, 2, 1 respectively, and get RLS{[n]'^) = n{n'^ /{\ogn + l)) = n{n'^/\ogn), 
RLS{[nf) = 0(n/(logn + 1/n)) = n{n/\ogn), and i?LS'([n]2) = n{n/i^+l)) = 

For the quantum lower bounds, if d > 6, we let m be the integer closest to 2d/3, thus to > 4. 
We get 

QLSiinf) = n ^,-mf„m/2 - m'^-^^) ifd^3d' + l. (99) 

^ ^ ' ^ [n{N^-^) if d^ 3d' + 2 

For d = 6, let TO = 4 and we have QLS{[n]^) = / logn). For d = 5, 4, 3, we let to = d — 2 and 
then QLS{[nY) = f](nV(n2-(''-2)/2 + n2-(''-2)/2)) ^ n{n'^''^-^), which is n{n^/'^),n{'n?),n{rv^/'^), 
respectively. For d = 2, let to = 1 and QLS{[nY) = = n{n^/*). 



4.2.2 Improvement 

One weakness of the above proof is the integer constraint of the dimension to. We now show a way 
to get around the problem, allowing m to be any real number between and d — 1. The idea is 
to partition the grid into many blocks, with different blocks representing different time slots, and 
the blocks are threaded into one very long block by many paths that are pairwise disjoint. Roughly 
speaking, we view [n]'^ as the product of d line graph [n]. For each of the first d — 1 line graphs, 
we cut it into n^~^ parts evenly, each of size . (Here r — to/ (d — 1)). Then is partitioned 

into smaller grids, all isomorphic to [n'']'^^^. Putting the last dimension back, we have 

blocks, all isomorphic to [n'"]''^^ x [n]. Now the random walk will begin in the first 
block, and within each block, it is just one step of random walk in [n'']'^"^ followed by two steps of 
one-way walk in the last dimension space [n]. When the walk runs out of the clock [n], the walk 
will move to the next block via a particular block-changing path. All block-changing paths are 
carefully designed to be disjoint, and they "thread" all the blocks to form a [n'']''""'^ x [L] grid, where 
L = (n — 2n'')n'-^~''-"-''~^^ (L is not n-n^^~^''^'^~^'> because we need 2n^ points for the block-changing 
paths.) Figure 121 is an illustration for the case of d = 2. 

We now describe the partition and the walk precisely. For x — xo---Xd-i in [n]'^, let x^*^^^' = 
xo...Xk-ilxk+i---Xd-i, and = xo...Xk-i{xk + i)xk+i---Xd-i, where i satisfies Xk + i [n]. 

Recall that a;(*) " = ^{i)=ma.^{x,-lA} ^^^^ ^(»),+ ^ ^{i)=min{x,+l,n} ^ 

For any fixed constant r E (0,1), let a = [n^l, /3 = [n^~''J and n' — a/3. Note that n' > 
{n^ — l){n^~^ — 1) = n — o{n). We now consider the slightly smaller grid [n']'^. Let Vi be the 
set [n']'^^^ — {xo...Xd-2 ■ Xi £ [n']}. We cut Vi into f]"^"^ parts {xo...Xd-2 ■ {h — l)a < Xi < 
fcia}/jQ jt^_2e[;3]d-i, each of which is a small grid isomorphic to [o;]''"^. We then refer to the set 
{xo---Xd-2Xd-i ■ iki — l)a < Xi < kiU, z = 0, d— 2, a < Xd-i < n' — a\ as the "block (fco, kd-2)" ■ 
Note that {ko, kd-2) can be also viewed as a point in grid and there is a Hamilton path 

HamPathp^d-i in as defined in Section 2. We call the block (/cq, fc^_2) the next block of 

the block (feg, kd-2) if {k'^, fc^_2), viewed as the point in is the next point of (/cq, kd-2) 

in HamPathjs^d-i- Note that by our definition of HamPath/s^d-i, we know that 3i e {0, d — 2} 
s.t. k^ G {ki + l,ki — 1} and for all other j 7^ i, kj = kj. That is, adjacent blocks have only one 
coordinate to be different, and this difference is 1. We call the the block (ko, kd-2) the last block 
if (fco, kd-2) is the last point in HamPathp^d-i- 

Now we define the random walk by describing how a particle may go from start to end. The 
path set is just all the possible paths the particle goes along. Intuitively, within one block, the 
last dimension d — 1 serves as the clock space. So as before, we perform one step of line walk (in 
the dimension which is the circularly next dimension of the last one that the walk just goes in), 
followed by two steps of walk in the clock space. If we run out of clock, we say we reach a boundary 
point at the current block, and we move to the next block via a path segment called block- changing 
segment. In what follows, we specify how the particle may move during the whole random walk 
process, including going through block-changing segments. We always use XQ...Xd-i to denote the 
current position of the particle, and assume Xi — {ki — l)a + y^, i.e. x is in the block (/cq, kd-2) 
with the offsets (yoi ■••i Ud-i)- Thus the instruction xq — xq + I, for example, means that the particle 
moves from XQ...Xd-i to (xq -|- l)xi...Xd-i. 
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block 1 block 2 
1 - a a+1 - 2a 



dimension 1 



block P 
n'- a+1- n' 




r r > 

boundary point block-changing segment 

dimension 

Figure 2: Illustration for changing a block in the 2-dimensional grid 



1. Initially xq = ... = Xd-2 = 0, Xd-i = a + 1, fco = ... = kd-2 = 1. 

2. for i = 1 to (n' - 2a)(5'^-^, 

Let t' = L;7^J, i = {t - I) mod [d - 1) 

do either Xi = maxjcci — 1, {ki — \)a + 1} or Xi = minjxi + 1, kio} randomly 
if t ^ k{n' — 2a) for some positive integer k, 

do Xd-i = Xd-i + (-1)*' twice 
else (t/ie particle is now at a boundary point) 

if the particle is not in the last block 

(Suppose the current block changes to the next block by increasing kj by 6 e {—1, 1}) 

do Xd-i = Xd-i + (—1)* for + 1 — yj) times 
do Xj = Xj + b for 2{a + 1 — yj) — 1 times 
do Xd-i = Xd-i + (-1)*'+^ for (a + 1 - yj) times 
kj — kj ~\~ b 
else 

The particle stops and the random walk ends 

It is easy to verify that every boundary point has one unique block-changing segment, and 
different block-changing segments do not intersect. Also note that we do not let the clock tick when 
we are moving from one block to the another. Thus the block-changing segments thread all the 
blocks to form a [a]'*^-'^ x [L] grid, where L = (n' — 2a)/3'^^^. Actually, for our lower bound purpose, 
we can think of the random walk as performed in the product graph [a]''"^ x [L]. We will next 
make this clearer as below. 

What we care about is, as before, the probability that the random walk starting from a point 
X = Xo...Xd-i passes another point x' = x'q...x'^_-^. Note that for any point x (including those on the 
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block-changing segments), there is only one time t when the walk may hit x, and this t is known by 
X itself. Similarly we use t' to denote the time when the path passes x' . Denote the probability that 
the random walk starting from x passes x' by Pr[a; x'\. As before suppose Xi = {ki — l)a + yi 
and x'i = m - l)a + y[ for i e {0, d - 2}. 

We first consider the case that one of the two points, say x' is on a block-changing segment. Since 
different block-changing segments never intersect, a path passes x' if and only if the path passes 
the boundary point x" at the beginning of the block-changing segment that x' is in. Also note that 
the time that the path passes x" is also t' because the time does not elapse on the block-changing 
segment. So it holds that Pr[a: x'] = Pr[a: — > x"], and it is enough to consider the case that both 
X and x' are not in clock-changing segments. 

Now suppose both x and x' are not in clock- changing segments. In general, x and x' may be not 
in the same block , so going from x to x' needs to change blocks. Recall that to change from the 
block (fco, kd-2) to the next one, only one ki changes by increasing or decreasing by 1. Suppose 
that to go to x' from x, we change blocks for c times, by changing ki-^, ki^, ki^ in turn. Let 
Uj — \{s £ [c] : is ~ j}\. Note that to get to x' from x after t' — t steps, the coordinate j needs to 
be x'j after t' — t steps for each coordinate j £ {0, d — 2}. It is not hard to see that if a block- 
changing needs to change kj by increasing b G {—1, 1}, then among all the offsets y^'s, only the yj 
gets changed, and the change is a reflection within the block. That is, suppose Xj is {kj — l)a + yj 
before the block-changing, then Xj changes to {kj + 6 — l)a + (a + 1 — yj) after the block-changing. 
So if c = 1, then Pr[a; x'] is equal to the probability that a random walk in [a]"^"^ starting from 
yo.-.yd-2 hits y'^...y'^^^ after exactly t' - t steps, where y'- = y'^ if j ^ n and ?/■' = a -I- 1 - y[^. 
For general c, Pr[a; x'] is equal to the probability that a random walk in [a]''^^ starting from 
yo---yd-2 hits yQ---y'd-2 after exactly t' — t steps, where y'j = y'j if rij is even and y'J = a + 1 — y'j if 
Uj is odd. Note that this probability has nothing to do with the block- changing; it is just the same 
as we have a clock space [{n' — 2a)(3'^~^] to record the random walk on [a]''^^. Thus we can use 
Proposition ^2 to upper bound this probability and just think of the graph as [n'']'*^^ x [L] and use 
Theorem El with G"" = [n'']'^-^ and 6"= = [L]. 

Now we have T = [L/2\ and pt = 0{1/VF^) for t < n^'' and pt 0(l/n''('^-i)) for t > n^"" . 
So for randomized lower bounds, if d > 4, then let r = d/ {2d — 2) and we get 

If d = 3, let r = 3/4 - loglogn/(41ogn), and we get RLS{[nf) = Vl{{n^ / Xognf/'^). For d = 2, let 
r = 2/3 and we get RLS{[nY) = n{n'^/^). 

For the quantum lower bounds, if d > 6, then let r = 2d/ {"id — 3) and we get 

QLS{[nY) - ^ U+(-^)(-^)/ ( g ^ + \.(.-.)/. 1 1 = ^in'^")- (101) 

If d = 5, then let r = 5/6 - log log n/ (6 log n) and QLS{[nf) = ^{{it' j Xognfl'^). For 2 < d < 4, 
we let r = d/{d+l), then QLS{[nY) = n{n'^/^-'^/^'^+'^^), which is n{v?-/^), Q.{n^l'^), n{n^'^) for 
d = 2, 3, 4, respectively. 

4.2.3 Further improvement on 2-dimensional grid [n]^ 

Some other random walk may be used to further improve the lower bound on low dimension grid 
cases. Here is one way to improve QLS{[nY') from ^{-n}^^) to Vl{n^/^). We cut the graph [n]^ into 
^2/b snialler grids, each of size n^/^ x n^l^ . Without loss of generality, assume both n^/^ and n^l^ 
are integers, and further assume rt^/^ = 3 mod 4; otherwise we can consider a slightly smaller grid 
by the simple trick as at the beginning of Section 14.2.21 We shall use a random walk similar to 
Aaronson's in [2] as follows in each block, and change blocks after each step. Thus different blocks 
to record different time. 



RLS{{nf) = f7 
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For any time t € [n^/^{n^/^ - 1)], suppose t = 2rn^/^ + t' where r £ {0, 1, {n^/^ - 3)/2} and 
t' e {l,2,...,2ni/5}. Let 

fo if = 0, 1 (mod 4) 



1^/5 if t' = 2,3 (mod 4) 



(102) 



Let hlock(t) as the smaU grid 



'{(x = ([i'/2] - l)n'^/^ ^ x' ,y = 2rn'^'^ + u ^ y') : x',y' S [n^/^]} if r is even 
{{x= (ni/^ - [t72])n4/5 + a;',y = 2m4/5 + 7i + y') : x\y' £ [n^/S]} if r is odd 



(103) 



The {x',y') is called the offset of {x,y). Now define the random walk as follows and as depicted in 
Figure 13 



t=2-l"+l 




Figure 3: A different random walk in the 2 dimensional- grid 



Initially {x,y) = (1,1) 

for t = 1,2,..., n^/^(n^/^ — 1) (Suppose the current point is {x, y) with offset (x', y')) 
if t' is odd 

pick a random x" e [?^^^^], move horizontally to the point in block{t) with the offset (x", y') 
else 

if t' = 2ni/5 then c = 1 else c = 

pick a random y" £ [n^^^], move vertically to the point in block{t + c) with the offset (a;', y") 

We then follow the same track as in the proof of Theorem O To get a reduction from Local 
Search on [rt]^ to the Pathp problem, we define the function 

f ( ,i\v-{l,l)\inr iiviset{X) 

|-27i4/5(i-l) - (-!)'■ .T; + (-l)r*'/2ly; iiv£set{X)C^block{t) ^ ' 

Intuitively, the function value decreases along the path as before. But the decrement is not always 
by 1: each block has its fixed value setting. If for example the path passes through the block toward 
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right and down (as in the first block), then the value —x' — y' is used within the block. In this way, 
we do not need to know the length of the path segment from top to v to calculate each fx{v)- 

What we care about is still, as in Equality (|34|l . the probability that the path X' passes another 
point X on X, under the condition that X' AY — k' . It is not hard to see that this probability is 
0(1) in general if x is in block{k'), and Q{l/n^^^) otherwise {i.e. when x is in block{t) for some 
t> k'). Thus by L = e{n'^/^) we have 

QLSiinf) = n (n^/s/ (l + n^/^/ V^)) = n{n^/^) (105) 

This completes the proof of Theorem |31 

Note that this random walk suffers from the fact that the "passing probability" is now n'^^^ times 
the "hitting probabihty". So for general d, we can get RLS{[n]'^) = n{n'^/^'^+^'>) and QLS{[n]'^) = 
J7(j7,ii/(2<i+i)^^ which only gives better results for QLS on the 2-dimensional grid. 

5 New algorithms for Local Search on general graphs 

In 01 Ej J a randomized and a quantum algorithm for Local Search on general graphs are given as 
follows. Do a random sampling over all the vertices, find a vertex v in them with the minimum 
/-value. (For the minimum /-value finding procedure. The randomized algorithm in 01 just queries 
all these vertices and find the minimum, while the quantum algorithm in [2] uses the algorithm 
by Durr and Hoyer [TT] based on Grover search ,12. to get a quadratic speedup.) If u is a local 
minimum, then return v; otherwise we follow a decreasing path as follows. Find a neighbor of v with 
the minimum /-value, and continue this niinimum-value-neighbor search process until getting to a 
local minimum. We can see that the algorithms actually fall into the generic algorithm category 
(see Section 1), with the initial point picked as the best one over some random samples. 

In this section, we give new randomized and quantum algorithms, which work better than this 
simple "random sampling -I- steepest descent" method when the graph expands slowly. Here the idea 
is that after finding the minimum vertex v of the sampled points, instead of following the decreasing 
path of V, we start over within a smaller range, which contains those vertices "close to" v. If this 
smaller range contains a local minimum for sure, then we can simply search a local minimum in it 
and do this procedure recursively. But one caveat here is that a straightforward recursion does not 
work, because a local minimum u in the smaller range may be not a local minimum in the original 
larger graph G (since u may have more neighbors in G). So we shall find a small range which has 
a "good" boundary in the sense that all vertices on the boundary have a large /-value. 

Now we describe the algorithm precisely, with some notations as follows. For G = {V,E), a 
given function / : 1/ — > N, a vertex v G V and a set S* C V, let n{v, S) = \{u E S : f{u) < f{v)}\. 
The boundary B{S) of the set S CV is defined by B{S) ^ {u € S : 3v E V - S s.t. (m, v) £ E}. In 
particular, B{V) = 0. A decreasing path from a vertex v E V is a. sequence of vertices vq, vi, Vk 
such that vo — v, Vk is a local minimum and /(wi+i) = min^.j^^.^-jg^ f{v) < f{vi) for i — 0, k~l. 
We write f{u) < f{S) if f{u) < f{v) for all v e S. In particular, it always holds that f{u) < /(0). 
Suppose d — maxu ^gy \u — v\ is the diameter of the graph, and 5 = max^gy |{" ■ i^jv) € E}\ is 
the max degree of the graph. In the following algorithm, the asymptotical numbers at the end of 
some command lines are the numbers of randomized or quantum queries needed for the step. For 
those commands without any number, no query is needed. 

1. mo = d, C/o = V; 

2. i = 0; 

3. while (|toj| > 10) do 

(a) Randomly pick (with replacement) [^|^ log ^] vertices from i/^, where ei — l/(101og2 c?); 

(b) Search the sampled vertices for one Vi with the minimal / value. 

- Randomized algorithm: query all the sampled vertices and get Vi. — O ( log ^ j 
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- Quantum algorithm: use Durr and Hoyer's algorithm with the error probability at 
most £2 = 1/(10 log2 d). - O f^/^ log i log 1 



(c) if i = 0, then m+i = w^; 

else if f{ui) < f{vi), then Ui+i = 
else Mi+i = 

(d) for J = 1,2,... 

i. Randomly pick e Mi — {m : mi/8 < m < mi/2, \W{m)\ < 10|?7i|/TOi}, where 
W{m) — {w £ Ui : \w — Mi+i| = m}. Let Wij — W{mij). 

ii. Test whether < f{W^j) 

- Randomized algorithm: query all vertices in Wij. — 0(|Wij|) 

- Quantum algorithm: use Durr and Hoyer's algorithm on Wij with the error 

probability at most ea = 1/(200 log2 d). — O (^^y\W,J\\og 

iii. If the answer is Yes, jump out of this for loop and go to SteolSel 

(e) Ji = i, m^+i = TOij, Wi = Wij, Ui+i ^ {u eUi :\u- it^+il < m^+i}; 

(f) i^i + l; 

4. I^i; 

5. Follow a decreasing path of uj to find a local minimum. 

- Randomized algorithm: in each step, query all the neighbors — 0(6) 

- Quantum algorithm: in each step, use Durr and Hoyer's algorithm with the error probability 
at most 1/100 — 0{VS) 

Define c(fc) — maxygy \{u : \u — v\ < k}\. Apparently, the expanding speed of a graph is upper 
bounded by c(fc). The following theorem says that the algorithm is efhcient if c(fc) is small. 

Theorem 12 The algorithm outputs a local minimum with probability at least 1/2. The randomized 
algorithm uses O (X^f^o^ '^1™'^ log log d) queries in expectation, and the quantum algorithm uses 



O yJ2i^Q Y (log log d)^'^j queries in expectation. 

In case that c{k) — 0{k'^) for some a > 1 and fc = 1, ...,d, the expected number of queries that 
the randomized algorithm uses is O ^ ^_^iri log log if a > 1 and 0(log(iloglogc?) if a = 1. The 

expected number of queries that the quantum algorithm use is O ( ^ i ~J (loglogd)^'^ ) if a > 1 

\i-2— ) 

and 0{logdloglogd) if a — 1. 

Several comments before proving the theorem: 

1. lim„^i f_„iri = lim^^i ^^^^^^ logs d 

2. If a - 1 > e for some constant e > 0, then fj,\'^ = e(d"-i) and ^^^4^ = Q{d'^°'-^^^^). 

l-2~2- 

If further the bound c(fc) = 0(fc") is tight in the sense that N = c{d) = e(rf"), then RLS{G) = 
O (flog log d) and QLS{G) = O (^f (loglogd)i-5) . 

3. For 2-dimensional grid, d = 0(n) and a = 2. Thus Theorem |S1 follows immediately. 

Proof We shall prove the theorem for the quantum algorithm. The analysis of the randomized 
algorithm is almost the same (and actually simpler). We say Wi is good if /(u^+i) < f{Wi). We 
shall first prove the following claim, then the theorem follows easily. 

Claim 3 For each i = 0,1, I — I, the following three statements hold. 
1. n{ui+i,Ui+i) < n{ui+i,Ui) < mi/8 < m^+i with probability 1 — ei — £2- 
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2. If n{ui^i, Ui) < mi/8, then Wi is good with probability 1 — 63 J^, and E[Ji] < 2. 

3. If Wo, ■■■,Wi are all good, then /(ui+i) < f{B{Ui+i)), and Ui+i (/ B{Ui+i). 

Proof n In Step 123 -03 denote by 5 the set of the [^|^log^] sampled vertices in Step I3al 
Let a — min„£5/(u), then \{v e Ui : f{v) < a}\ < mi/8 with probability at least 1 — ei. The 
Vi found in Step I3bl achieves the minimum in the definition of a with probability at least 1 — 62 . 
Put the two things together, we have n{vi, Ui) < mi/8 with probability at least 1 — ei — 62. Since 



f{ui+i) < fivi) (by Step|2cj), Ui+i C Ui (by StepOil) and m^+i > mi/8 (by Step 3(d)il, we have 
n{ui+i, Ui+i) < n{ui+i, Ui) < n{vi, Ui) < mi/8 < mi+i with probability at least 1 — ei — €2. 

13 We say an my is good if the corresponding Wij is good, i.e. f{ui+i) < f{Wij). Note that 
for any m^- G [mi], we have Wij C Ui, and also have Wij D Wij' = if m^j 7^ m,iji. Therefore, 
if n{ui^i,Ui) < mi/8, then at most mi/8 distinct m^-'s in [mi] are not good. Also note that 
the number of distinct m^j's s.t. [W{mij)[ > 10[Ui[/mi is less than 771^/10. Therefore, [Mi[ > 
(| — j^)mi > mi/4. So if n(ui+i, Ui) < mi/8, a random m^j in Mi is good with probability at least 
1/2, and thus E[Ji] < 2. Also the probability that all the Grover searches in Step 3(d)ii are correct 
is at least 1 — J,; £3. 

01 We shall first prove B{Ui+i) C B{Ui) U Wi. In fact, any s e B{Ui+i) satisfies that s e Ui+i 
and that 3t e V - Ui+i s.t. |s - t| = 1. Recah that Ui+i QUi, so \it - Ui, then s e B{Ui) 
by definition. Otherwise t € Ui — Ui+i, and thus t ^ Ui and [t — Ui+i[ > mi+i by the definition of 
Ui+i. Noting that |s — < 771^4-1 since s G C/^+i, and that |s — 1| = 1, we have |s — 7ti+i| = 777^+1, 
which means s £ Wi. Thus for all s e B{Ui-i-i), either s £ B{Ui) or s £ Wi holds, which implies 
BiU,+i)CB{U,)UW,. 

Applying the result recursively, we have B{U,+i) C B{Uq) U Wq U ... UW, = WoU ... U W,. Since 
we have f{u,+i) < f{ui) < ... < f{ui) (by Step 03 and f{uk+i) < f{Wk) (for k = 0,...,z) by 
the assumption that all Wk's are good, we know that f{ui+i) < f{Wo U ... U Wi), which implies 

f{u^+l) < f{B{U,+ i)). 

For the other goal Ui+i ^ B{Ui+i), it is sufficient to prove Ui+i ^ B{Ui) and u^+i ^ Wi. The 
latter is easy to see by the definition of Wi. For the former, we can actually prove Uk+i ^ B{Uk) 
for all k = 0,...,i by induction on k. The base case of fc = is trivial because B{Uo) = 0. 
Now suppose Uk ^ B{Uk-i). There are two cases of Uk+i by Step 03 If f{uk) < f{vk), then 
Uk+i = Uk </. B{Uk-i) by induction. Again by the definition of Wk-i we know that Uk ^ Wk-i 
and thus Uk+i ^ Uk </. B{Uk). The other case is f{uk) > f{vk), then Uk+i = Vk, and therefore 
/(ufc+i) = f {vk) < f{uk) < f {B{Uk)) (by the first part inOIl, which implies that Uk+i i B{Uk). □ 

(Continue the proof of Theorem I12|l Now by the claim, we know that with probability at least 
1 — /(ei -|- £2) ~ ^iZo ^6 '^ill have that 

n{ui,Ui)<mi, f{ui)<f{B{Ui)), m (/ B{Ui). (106) 

Note that the correctness of the algorithms follows from these three items. Actually, by the last 
two items, we know that any decreasing path from ui is contained in Ui. Otherwise suppose 
[vPj, u\, uj) is a decreasing path from uj (so 77^ = uj), and the first vertex out of Uj is Mj, then 
Tij^^ £ B{Ui). Since vPj ^ B{Ui), we have t — I > and thus f{u]~^) < f{ui), contradicting to 
f{ui) < f{B{Ui)). Now together with the first item, we know that any decreasing path from ui is 
no more than 777/ long. Thus Step 01 will find a local minimum by following a decreasing path. 

The error probability of the algorithm is /(ei -|- 62) -I- Je3 -I- 10/100, where J = J2i=o ^^''^^^ 
E[J] — 21, we know by Markov inequality that with J < 20/ with probability at least 9/10. Since 
ei = £2 = l/(101og2rf) and £3 = 1/(200 logj d), and note that / < log2 d because mo — d and 
mi+i < \mi/2]. So the total error probability is less than 1/2. 

We now consider the number of queries used in the 7-th iteration. Note from Step ^ and Step 
03that [Ui[ < c{mi) for z = 0, 1, / — 1. So Step I3bl uses 




log log d log log d I = O I j£^(loglogd)i-5 I (107) 
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queries. Also note from Step 3(d)i that \Wij\ < 10\Ui\/mi, so SteplSdJuses 0(^^^^ y/c{mi)/mi log log d) 
queries, which has the expectation of 0{yj c{mi) /rrii log log d) . Finally, Step[Sluses 0{^f6) queries. 
Note that 5 = c(l) = 0{c{mj)/mi) where m/ is a constant integer in the range [6, 10]. Altogether, 



the total expected number of queries used is 




Vc{mi)/mi (loglogd)i-5 I . (108) 

i=0 J 

If c{k) = 0{k°') for some a > 1 and k — 1, d, then 



logo d—1 ! ^ log2 d—1 

i=0 V i=Q i=0 



where /3 = (a— 1)/2. This completes the proof for the quantum algorithm, except that in the case of 
a = 1 we only have a quantum upper bound of O(log(i(loglog(i)^'^). But note that the randomized 
algorithm uses 0(logc?loglogd) queries (because of the saving at error probability controls). So 
when a — 1, the quantum algorithm just uses the randomized one. □ 



6 Open problems: remaining gaps 

We list those grids on which the query complexities of Local Search still have gaps. 



d = 


2 


3 


old RLS 


im-.Oin)] 


[0(V^),0(nt)] 


new RLS 


[nini),0{n)] 


[n{ni/(\ogn)i),0{n^)] 


remaining gap 


713 (= Ne) 


(logn)^ (= (logA)^) 



d ^ 


2 


3 


4 


5 


old QLS 


[n{ni),0{ni)] 


P{ni),0{n)] 


[17(n5),0(nt)] 


[17(n3),0(nt)] 


new QLS 




Mni),0{n)] 




[^7(r^V(log^^)^),0(r^3)] 


remaining gap 


nio (= A^2o) 


n4 (= A^T2 ) 


n 15 (= A 30 j 


(logn)^ (= (logA^)3) 



where A^ = n'^ is the number of the vertices in the grid. 
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